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Abstract: 

A complete system for old picture restoration is described: in particular, a frame 
alignment method, a simple deblotching algorithm and a nonlinear approach for 
contrast enhancement are proposed. The frame alignment uses a global motion 
compensation, with a logarithmic search for the correction vector. The blotch removal 
step consists of two stages. Blotches are first detected using two suitable morphological 
operators; the resulting pixel maps are merged and then validated using an estimate of 
the motion. Secondly, a multilevel median filter is used to replace sets of pixels 
identified as blotches. For contrast enhancement we use a rational unsharp masking 
technique which is able to effectively treat the high resolution images. To comply with 
the film properties the sharpening operator acts strongly in the dark regions and 
weakly in the bright ones. It can also reduce noise in homogeneous areas 
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pel$l or (picture adj elemental) or 
gray$6 or grey$6)) near6 (region$l or 
area$l or column$l or row$l or 
neighborhood$l or section$l or 
part$l or portion$l or block$l)) and 
((normali$6 or calibrat$3 or dark$4 or 
black$4) near4 (mean or average or 
median)) 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBMJTJB 


OR 


OFF 


2004/09/09 14:21 


S30 


327 


(((average or mean or median) near3 
(brightness or luminance or pixel$l or 
pel$l or (picture adj elemental) or 
gray$6 or grey$6)) near6 (region$l or 
area$l or column$l or row$l or 
neighborhood$l or section$l or 
part$l or portion$l or block$l)) same 
((normali$6 or calibrat$3 or dark$4 or 
black$4) near4 (mean or average or 
median)) 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


OFF 


2004/09/09 14:24 
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S31 


5543 


((average or mean or median) near3 
(brightness or luminance or pixel$l or 
pel$l or (picture adj elemental) or 
gray$6 or grey$6)) near3 (region$l or 
area$l or column$l or row$l or 
neighborhood$l or section$l or 
patt$l or portion$l or block$l) 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBM_TDB 


OR 


OFF 


2004/09/09 14:24 


S32 


246 


(((average or mean or median) near3 
(brightness or luminance or pixel$l or 
pel$l or (picture adj element$l) or 
gray$6 or grey$6)) near3 (region$l or 
area$l or column$l or row$l or 
neighborhood$l or section$l or 
part$l or pottion$l or block$l)) same 
((normali$6 or calibrat$3 or dark$4 or 
black$4) near4 (mean or average or 
median)) 


US-PGPUB; 
USPAT; 
EPO; JPO; 
DERWENT; 
IBMJTDB 


OR 


OFF 


2004/09/09 14:25 


S33 


23706 


(mean or average) near2 (gray$6 or 
grey$6 or ((pixel or pel or (picture 
element)) adj value$l) or intensit$3 or 
brightness$2 or luminance) 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBMJTDB 


ADJ 


OFF 


2004/11/27 15:26 


S34 


4409 


(mean or average$l) near3 
derivative$l 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBMJTDB 


ADJ 


OFF 


2004/11/27 17:01 


S35 


71 


S33 and S34 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBMJTDB 


ADJ 


OFF 


2004/11/27 14:23 


S36 


40095 


(uniform or stable or constant or 
consistent) near2 (gray$6 or grey$6 or 
((pixel or pel or (picture element)) adj 
value$l) or intensit$3 or brightness$2 
or luminance) 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBMJTDB 


ADJ 


OFF 


2004/11/27 14:46 


S37 


6111 


S36 near6 (region$l or area$l or 
column$l or row$l or neighborhood$l 
or section$l or part$l or portion$l or 
block$l) 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBMJTDB 


ADJ 


OFF 


2004/11/27 14:46 


S38 


40237 


(uniform or stable or constant or 
consistent or homogenous) near2 
(gray$6 or grey$6 or ((pixel or pel or 
(picture element)) adj value$l) or 
intensit$3 or brightness$2 or 
luminance) 


US-PGPUB; 
USPAT; 
USOCR; 
EPO; JPO; 
DERWENT; 
IBM TDB 


ADJ 


OFF 


2004/11/27 14:46 
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S39 


6137 


S38 near6 (region$l or area$l or 
column$l or row$l or neighborhood$l 
or section$l or part$l or portion$l or 
block$l) 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


ADJ 


OFF 


2004/11/27 14:47 


S40 


185 


S39 same (((black$4 or darkness or 
min or minim$3 or max or maxim$3 or 
lowest or highest or greatest) near2 
(value$l or level$l or gray$6 or 
grey$l)) or darkest or blackest) 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


ADJ 


OFF 


2004/11/27 14:48 


S41 


897 


(median) near2 (gray$6 or grey$6 or 
((pixel or pel or (picture element)) adj 
value$l) or intensit$3 or brightness$2 
or luminance) 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


ADJ 


OFF 


2004/11/27 15:26 


S42 


43 


(median) near3 derivative$l 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


ADJ 


OFF 


2004/11/27 15:26 


S43 


0 


S41 and S42 
• 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


ADJ 


OFF 


2004/11/27 15:26 


S44 


4125 


((382/181, 190, 195,206,272,274, 173, 
180) or (358/504,406)).CCLS. 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/27 16:50 


S45 


10 


(S34 or S42) and S44 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/27 16:51 


S46 


6 


S45 not S35 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/27 16:51 


S47 


3637 


(mean or average$l or median) near3 
slope 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


ADJ 


OFF 


2004/11/27 17:01 


S48 


197 


S33 and S47 


US-PGPUB; 

USPAT; 

USOCR; 

EPO; JPO; 

DERWENT; 

IBM_TDB 


ADJ 


OFF 


2004/11/27 17:02 
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S49 


58 


S33 same S47 


US-PGPUB; 
USPAT; 
USOCR; 
EPO; JPO; 

DERWENT' 

Ls Ll\ VV l_ 1 ¥ 1 i 

IBM_TDB 


ADJ 


OFF 


2004/11/27 17:09 


S50 


916 


(382/173, 180).CCLS. 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:11 


S51 


79851 


(dark$3 or black$3 or lowest) near4 
(portion$l or region$l or area$l or 
partition$l or subportion$l or 

subreoion41 or subareaSI or 
subpartition$l or column$l or row$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:16 


S52 


252 


S50 and S51 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:15 


S53 


72511 


(dark$3 or black$3 or lowest) near3 
(segmental or portion$l or region$l 
or area$l or partition$l or 
subportion$l or subregion$l or 
subarea$l or subpartition$l or 
column$l or row$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:18 


S54 


67206 


(dark$4 or black$4) near4 (segment$l 
or portion$l or region$l or area$l or 
partition$l or subportion$l or 
subregion$l or subarea$l or 
subpartition$l or column$l or row$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:18 


S55 


64277 


(dark$4 or black$4) near4 (segment$l 
or portion$l or region$l or area$l or 
partition$l or subportion$l or 
^ubreaion^l or ^ubareaffcl or 
subpartition$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:18 


S56 


246 


S50 and S55 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:18 


S57 


26142 


(darkness or darkest or dark or 
blackness or blackest) near3 
(segmental or portion$l or region$l 
or area$l or partition$l or 
subportion$l or subregion$l or 
subarea$l or subpartition$l or 
column$l or row$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:19 


S58 


26169 


(darkness or darkest or dark or 
blackness or blackest or (black adj 
value$l)) near3 (segmental or 
portion$l or region$l or area$l or 
partition$l or subportion$l or 
*>ubrpnioni 1 or subareail or 
subpartition$l or column$l or row$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:37 


S59 


72 


S50 and S58 


US-PGPUB - 
USPAT 


OR 


OFF 


2004/11/29 11:35 


S60 


651 


segmentation and S58 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:36 
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JUX 


606 


^60 nnt 

JOU 1 IUL J J _7 


1 |c;-Pf^Pl |R- 

U J r urUD f 

USPAT 


OR 


OFF 
urr 


9004/1 1/29 li *3R 

t,UUl/ IX.JJ 




339 


ai iu ^ jui. / .p ui jjo /zpj.ULio* 


Uj rurUD, 

USPAT 


OR 


OFF 
urr 


?nn4/i 1/29 li '3fi 

tl/Ui/ XJ./ xx. JO 


S63 
jo j 


107 


f ^Pnmpnr^Hnn nr cpnmpnHnn^ camp 
^ocyi i ici iloliui l ui bcyi i ici ilii ly ^ bamc 

S58 


USPAT 


OR 


OFF 


9004/11/29 11 '37 

tUU"/ll/fc? XX. J/ 


S64 

JU~ 


74 


^fi3 and ("W)"ft nr "3W/<fc^ rrk 
jwj aliu ^ Jut, / .p UI jjo /.pJ.ULIo- 


1 l^-P^PUR' 
USPAT 


OR 

Win 


OFF 
urr 


9004/1 1/9Q 1 1 '37 


S65 


63 


S64 not S59 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:38 


S66 


25377 


(darkness or darkest or dark or 
blackness or blackest or (black adj 
value$l)) near3 (segmental or 
portion$l or region$l or area$l or 
partition$l or subportion$l or 

qi ihrpninrj<fc1 nr cnHarpa<fc1 nr 

OUUI CyiUI l*pl UI bUL/CH tzaq>l UI 

subpartition$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/12/02 12:27 


S67 


1UJ 


f cpnrnpnraHnn nr cpnmpnrinn^ camp 
^ocyi 1 ici itotiui 1 ui oty 1 1 ici ilii ly j ociimc 

S66 


I icr.pfrpi iR- 

UJ rurUD, 

USPAT 


OR 


OFF 
urr 


9004/1 1 /9Q 1 1 -37 


S68 


70 




1 ic:_p(-;p[ |R- 
USPAT 


OR 


OFF 


9004/1 1 /9Q 19-19 

^UU"/ll/tJ 


S69 


59 
j j 


^68 not 

JUL) I IUI JJ? 


iic.pfrpi in- 

uj ruruD; 

USPAT 


OR 

VJi\ 


OFF 
wrr 


9004/1 1 /9Q 1 1 -^0 

LUUl/ll/iJ XX.jVJ 


S70 


i 


("5,327,262").PN. 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 11:50 


S71 


1651 


((uniform$2 or constant or stable or 
consistent or flat) near (gray$6 or 
grey$6 or brightness$2 or intensit$3 
or luminance)) near3 (segment$l or 
portion$l or region$l or area$l or 
partition$l or subportion$l or 

<?i ihrpninntl nr ciiharpatl nr 

subpartition$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 12:38 


S72 

J/ t_ 


286 


S71 and ^66 

j / x aiiu juu 


1 IQ-Pf^PI IR- 
Uj rurUD; 

USPAT 


no 

VJrv 


OFF 
urr 


■?nn4/i 1 ijq 1 9 


S73 


76 


S72 and ("382"/$ or "3587$).ccls. 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 12:38 


S74 


1123 


(homogenous) near3 (segment$l or 
portion$l or region$l or area$l or 
partition$l or subportion$l or 

^uhrpninntl nr cMharpa*t1 nr 

subpartition$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 12:38 


S75 


49 


S74 and S66 


IK-PGPI IR- 

USPAT 


OR 

vjr\ 


OFF 


2004/11/29 12'38 

£-\J\J i/XX/£.J l^tJU 


S76 


19 


S75 and ("382"/$ or "3587$).ccls. 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/11/29 12:39 
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S77 


61 


(darkest or blackest or ((most or 
highest or greatest) adj (black or 
dark))) near3 (region$l or area$l or 
neighborhood$l or section$l or 
part$l or portion$l) 


DERWENT 


OR 


OFF 


2004/12/01 17:56 


S78 


1194 


(darkest or blackest or ((most or 
highest or greatest) adj (black or 
dark))) near3 (region$l or area$l or 

npiahhorhoodtl nr <;prtinn<fc1 nr 
part$l or portion$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/12/02 12:23 


S79 


450 


S78 and ("3827$ or ,, 358"/$ or 
M 348'7$)xcls. 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/12/01 18:05 


S80 


1203 


(darkest or blackest or ((most or 
highest or greatest) adj (black or 
dark))) near3 (region$l or area$l or 

npinhhnrhnnrit 1 nr Qfvrinntl nr 

part$l or portion$l or segment$l) 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/12/01 18:04 


S81 


198 


S80 and ( normali<fc6^ 

VII IVI 11 1 w 1 1 1 IUIIi^V J 


US-PGPUB- 
USPAT 


OR 


OFF 


2004/1 ?/fl1 1R-05 


S82 


110 


S81 and ("382"/$ or "358"/$ or 
"348"/$).ccls. 


US-PGPUB; 
USPAT 


OR 


OFF 


2004/12/01 18:05 
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